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Abstract 

This paper describes an approach to task sequence planning for a generalized robotic manu- 
facturing or material handling workcell. Given the descriptions of the objects in this system 
and all feasible geometric relationships among these objects, an AND/OR net which de- 
scribes the relationships of all feasible geometric states and associated feasibility criteria for 
net transitions is generated. This AND/OR net is mapped into a Petri net which incorpo- 
rates all feasible sequences of operations. The resulting Petri net is shown to be bounded 
and have guaranteed properties of liveness, safeness and reversibility. Sequences are found 
from the reachability tree of the Petri net. Feasibility criteria for net transitions may be 
used to generate an extended Petri net representation of lower level command sequences. 
The resulting Petri net representation may be used for on-line scheduling and control of the 
system of feasible sequences. A simulation example of the sequences is described. 

Keywords 

Task sequence planning, Petri net, AND/OR network, reachability, coverability, markings. 
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1 Introduction 


An automatic planning system is an essential part of a complete robotic system. A typ- 
ical planning system is a hierarchical top-down structure. Before the mechanisms and the 
robot start to work, the host computer in the system obtains the initial states and the final 
states. The planning system will represent and be able to generate all possible sequences 
of operations. Then a certain sequence will be chosen based on some evaluation criterion. 
Each operation which is included in this specific sequence will be considered as a sub-goal 
at that time. For each sub-goal, the lower level planning work will depend on the feasibility 
criteria of the AND/OR net. A lower level command sequence corresponding to each high 
level operation will be generated. Each lower level command sequence will be fired and each 
command could directly be used to control some mechanisms and the robot. During the 
execution, new information might be fed back to the computer, and the control commands 
may be updated to coordinate the whole system. 

The whole robotic system as well as its environment is in the initial state before the sys- 
tem starts working. The intelligent robot should have the ability to analyze the information 
it has from the outside world such as the descriptions of the current or initial states, the 
knowledge base that represents the set of conditional statements which defines the knowledge 
in the problem domain, and also the final states the system is expected to reach, and then 
reason so that it could automatically obtain all possible operation procedures to reach the 
final states. 

Task-level planning[l] provides a high-level sequencing of actions which satisfy domain 
constraints and ordering relations to accomplish a given task goal. Many domain-independent 
planning techniques and systems have been developed[2-4]. Most of these planning methods 
use search techniques developed in the artificial intelligence area. In robot workcells, and 
particularly assembly, domain-dependent planning methods are often more effective since 
they represent and reason about domain-related constraints[5-ll]. The aim of task level 
planning is to efficiently generate all possible task sequences and to be able to choose among 
them. Some sequences may contain fewer operation steps, and each different kind of opera- 
tion may have a different cost function. Some sequences may also contain parallel operations 
to save total time needed to fulfill the task. Depending on the task domain and application, 
we may have alternative cost functions, such as economic cost, minimum time, or maximum 
reliability, or we may require only that any feasible solution be found. 
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2 AND/OR Net Representation of the System 

The representation of assembly plans in our previous work is based on an AND/OR 
graph[5,8]. AND/OR graphs have and-arcs connecting one initial node to k terminal nodes. 
We review the basic definition of AND/OR graphs as follows: 

Definition 1 An AND/OR graph is a pair of sets (V, H) in which V is a finite set, and H 
is a subset of the cartesian product V x (fl(^) — {0})> where fl(^) * s the se ^ subsets 

of V. 

The elements of V are called nodes , and the elements of H are called and-arcs. For an 
and-arc (A, A), the node A is the initial node, and the nodes in A are the terminal nodes. 
The and-arc (A, A) is incident from A and is incident to the nodes in A. The and-arc (A, A) 
is said to connect node A to the nodes in A. 

In this section, we introduce the AND/OR net representation as a means to effectively 
represent geometric relations and constraints among objects and devices in the system. We 
are given a complete geometric description of objects and object relations, and have extended 
the AND/OR graph described above to represent more general relationships among objects 
as system substates. The AND/OR net is defined as follows: 

Definition 2 Pair-match set F: Given two finite sets Ei = {ai, a.2, ■ ■ ■ > a m} l £ 2 — 

b n }, 

m n 

r(s„s 2 ) = U 

•=i 3 = 1 

Definition 3 An AND/OR net is a three-tuple (S, A, N) where 5 is a finite set of states 
(s 1 ,s 2 ,..., 5 t ), A C r(S,n(S) - {0}), N C T(S,S), and A f)N = 0, where fK^) is the set 
of all subsets of 5. 

The elements of S are called nodes, the elements of A are called AND-arcs , and the ele- 
ments of N are called IST-arcs. The AND-arcs {A,?/>} is said to connect node A to the nodes 
in ip, tp C S. The IST-arc { At , A 2 } is said to connect node X x to the node A 2 . 1ST represents 
Internal State Transition. 

The definition of the system geometric states diagram is: 

Definition 4 System geometric states diagram lists all objects O t in the system and all 
possible states Of corresponding to each object. All possible assemblies of n objects, and 
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all possible subassemblies of m objects are special cases of objects, and subassemblies may 
be derived directly from assemblies. 

Note that in this discussion, a subassembly reflects any geometric configuration of con- 
tacting parts, including, for example, a robot holding a part. The system states diagram 
orders the representation of subassemblies by number of parts n. Each subassembly of order 
n may be further decomposed into II( n ) subassemblies. Only those decompositions which are 
geometrically feasible are included in the AND/OR net. In addition, objects with internal 
state changes are indicated by links. 

The AND/OR net is derived from the system geometric states diagram. The nodes in 
the AND/OR net correspond to all objects, which may be subassemblies and assemblies, 
appearing in the geometric states diagram. The AND-arcs represent the feasible decomposi- 
\ tions from subassemblies(assemblies) to a corresponding set of subassemblies. The IST-arcs 

represent the feasible internal state transitions from a subassembly (assembly) to another 
subassembly (assembly). These two subassemblies(assemblies) are listed in the same column 
in the geometric states diagram and contain the same number of original objects. 

An example of an AND/OR net definition is shown in figures 1 to 3. Figure 1 shows a 
robot which transfers an object to the surface of a table. The initial states and final states 
are presented in figure 1. All feasible geometric relationships among these objects are shown 
in the geometric states diagram in figure 2. 

The maximum number of steps of generating the final diagram is C* + C\ + • • • + C” = 
2" — 1, where n is the number of objects in the system and indicates the combinations 
of n. Within each step, we may obtain more than one configuration of contacting objects. 
The resulting AND/OR net state diagram is shown in figure 3 and is based on the feasible 
decompositions of subassemblies of order n to subassemblies of order no more than n — 1. In 
the next sections, we will describe the mapping of this AND/OR net to a Petri net. 

Methods for extracting all possible sequences from the AND/OR graph or AND/OR tree 
representation of the system will not work in this case. First, because cycles may appear 
in an AND/OR net, more difficulties may be met when we use the methods developed in 
AND/OR graphs for automatically searching task sequences. Secondly, depending on the 
definition, an AND/OR net possesses the special characteristic of reversibility. Last, we may 
consider AND/OR graphs or AND/OR trees as subsets of AND/OR nets. Therefore, it is 
necessary to introduce a searching algorithm for AND/OR nets. 
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(a) 



(b) 


Figure 1. Example of a Moving Task for a Robot 
(a) Initial states (b) Final states 
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ONE OBJECT 


TWO OBJECTS 


THREE OBJECTS 



Figure 2. System Geometic States Diagram 
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Figure 3. The AND/OR net representation for the example 

3 Mapping AND/OR Net to Petri Net 

The Petri net has been widely used in modeling manufacturing systems, computer sys- 
tems, and robot assembly planning systems as well as other kinds of engineering applications[12- 
19]. This is an efficient abstract and formal information flow model. The Petri net is char- 
acterized by its flexibility and efficiency in modeling and analysis of complex discrete-event 
systems. The definition and some relating terminologies are shown as follows. 

Definition 5 A Petri net structure, N, is a four-tuple, N = (P,T,a,f3). P = {p\,P 2 , ■ • ■ ,Pn} 
is a finite set of places, n~> 0. T = {t\,ti, • • • > t m } is a finite set of transitions, m > 0; P C\ 

T = 0. a C {P x T } and /3 C { T x P} are sets of directed arcs. 

Definition 6 Marking p: Marking p of Petri net A is a mapping from set P to set A = {0, 
1,2,.. ., L} which is a finite set, i.e. , 

p \ P -> A, 

where p sets tokens to every place in N, pi = p(p,) € A indicates the number of tokens in 
place pi, p can be in the form: 

p = (p 1 ,p2,--.,Pn) T ; Px =P(Pi), Px € P- 

Definition 7 Marked Petri net M: A Petri net structure N containing a marking p is a 
marked Petri net which is the following five-tuple, 

M = (P,T,a,0,p) 

Sometimes, for the sake of simplicity, we refer to a marked Petri net as a Petri net as 
shown later in this paper. 
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Definition 8 Petri net graph: The Petri net graph consists of directed arcs and two kinds 
of nodes. In the graph, circle node and bar node represent place and transition respectively. 
Directed arc, which links circle node and bar node, indicates the relation between place and 
transition. Marking p is shaped by solid dots in a circle node. 

One important property of a Petri net is the representation of serial and concurrent events 
ij and resource constraints. For this system, we use Generalized Stochastic Petri Nets(GSPN) 

j software[20,2l] to represent the system and carry out some simulations as well as verifying 

-„i the task sequences. 

Each node in the AND/OR net becomes a place in the Petri net. All transitions in the 
r : | system AND/OR network can occur in either direction. Based on this property, we can map 

each AND/OR net transition into two directed transitions in the Petri net. One difference 
between the AND/OR net and Petri net is that the same state in the AND/OR net could 
j appear more than one time. Thus the Petri net is a less efficient representation of the system 

states, but offers advantages in modeling the generation of sequences. 

For a transition {Ai,A 2 } 6 N in an AND/OR net, the mapping to elements in a Petri 
net is defined as a function where 

Pi({Ai,A 2 }) = (Ai, f 1 ) (J(*i, A 2 ) (J(A 2 , t 2 ) U(t 2 , Ai). 

For a Transition {A,^} € A in an AND/OR net, the mapping to elements in a Petri net 
. is defined as a function JF 2 , where 

k k 

r 2 ({\A}) = (A.eoU U('» A ')U IK^Ufe*). e 

1=1 1=1 

The algorithm for converting the AND/OR net to Petri net is shown as follows: 

Algorithm 1 Mapping from AND/OR net to Petri net. 

^ . Input: AND-OR net Na = (S,A,N). 

% Output: Petri net Np = (P, T, a, (3). 

1. initialize P = T = a = 0 = 0, np = nj = 0; 

2. for each set n, € N, n,- = {n,j,nj 2 } 

begin 

add 2 transitions t np+ i,t np+ 2 , 
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Figure 4. The Petri net representation for the example 

T — T U{inp + li t np+ 2}', 
rip = rip + 2; 

check whether is in P, 

if not in P, P = -PU{ n ii}; 
i/n,- 2 not in P, P = PU{ n i 2 }i 

a = aU{( ^«l) ^np+i ) i (^«2i ^np+ 2 )} i 

= /^U{(^np+l)^«2)i (^np+2) ^tl)}> 

end. 

3. for each set a{ € A, a,- = {a\,rp a } 

begin 

add 2 transitions t np+ \,tn P + 2 , 

T = TU{^np+l) ^np+2 } i 

rip = np + 2; 

for every e : € {{a^} UtM and {ej} f)-P = 0, 

P = P U{e,}; 

or = q U ) , (ej j tnp+ 2 ) } i Ihr all ej , 

jd — /?UUj{(^Tip+i7®A)i(^np+2)^j)}5 Ihr all ej , 

end 

Such a Petri net representation for the example in figure 1 is shown in figure 4. The 
initial marking of one token in places S, R and T represents the initial states, i.e., there are 
one robot, one table and one solid available and they are geometrically independent for the 
time being. The following properties of the resulting Petri net may be shown as follows: 
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(a) One neighbor 



Figure 5. The Connectedness with Pi and its 
neighboring Places 


Theorem 1 The Petri net mapped from an AND/OR net is safe. 

Proof: Because the Petri net is mapped from an AND/OR net, we should clarify the mean- 
ings of AND.arc and IST.arc again. The IST_arc in the AND/OR net corresponds to the 
internal geometric state change inside an object. All possible assemblies of n objects, and 
all possible subassemblies of m objects are special cases of objects. The AND .arc in the 
AND/OR net corresponds to combining geometric state changes among two or more objects. 

Suppose C = (P,T,a,P) with initial marking p. Choose any place p t € P, p' £ R(C,p), 
if we could verify that p'(pi) < 1 , then the proof is complete. 

Pi might connect with neighboring places in two ways(figure 5). 

Case 1: Corresponding to the internal change of geometric state of an object or a relating 
set of objects in the system(figure 5(a)). 

Suppose p\{pi) > 2. For simplicity, we assume p'/pf) = 2. There should exist t' < t such 
that p' t ,(pi) = 1 and p' f , +1 (p,) = 2. Therefore at time t' , p' t ,{pi) = p' t ‘(Pj) = 1, Pj and p, are 
neighboring places in the Petri net. Because the Petri net is mapped from the AND/OR net 
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and this case concerns the internal geometric change, we conclude that at the same time t , 
the two possible internal feasible states of a single object or a relating set of objects could 
appear simultaneously. The contradiction is thus obtained. 

Case 2: Corresponding to the change of interrelationship among two or more objects in 
the system. 

(i) pi is as shown in Figure 5(b). 

Also suppose p't(pt) = 2. There should exist t' < t such that p t i(pi) = 1 a.nd /V+r(P>) “• 

Therefore at time t ' , p' t >(pi ) = Pt'iPh ) = Pt'(Pjj) = ■•• = P-'t/Pik) = 1) Pt'(Pii)' "'■> Pt'(Pi»)i 
p't'(Pjk) are combining neighboring geometric states in the AND/OR net, 1 < u < k. 
We conclude that at the same time t’ , the two possible combining geometric states, which 
include exactly the same objects, could appear simultaneously. A contradiction is thus ob- 
tained again. 

(ii) pi is in the place of pj u as shown in Figure 5(b). 

Follow the same procedure as in case 1. We could conclude that at a time t\ two pos- 
sible combining geometric states, which contain at least one common object, would appear 
simultaneously. A contradiction is obtained. 

This statement of safeness concerning the Petri net is therefore assured. 

Corollary 1 The Petri net mapped from an AND/OR net is bounded. 

The corollary is directly derived from Theorem 1 because the number of tokens in any 
place cannot exceed 1. 

Theorem 2 The Petri net mapped from an AND/OR net is live. 

Prove: The Petri net mapped from AND/OR net consists of two kinds of subnet which are 
actually loops as shown in figure 5. Therefore, for any transition f,- in this Petri net and any 
p.' G R{C,p), where p is the initial marking, there exists a firing sequence a such that t , is 
enabled in 8(p',cr). We thus conclude that the transition t, is live at level 4 and therefore 
live. Because ti is an arbitrary transition, the Petri net is thus live. 

Theorem 3 The Petri net mapped from an AND/OR net is reversible. 
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Prove: As shown in the proof of Theorem 2, the Petri net is a set of loops according to the 
mapping definitions. Therefore, the initial marking is reachable from all reachable markings. 

The Petri net is thus reversible. 

The live Petri net guarantees a deadlock-free system. The boundedness property en- 
sures that the capacity is not exceeded. And the reversibility implies that the system can 
re-initialize itself, and it is important for the automatic recovery from errors and failures. 
Therefore, if a robotic assembly or handling system is represented as an AND/OR net, it 
is not only convenient for the system to generate task plans, but also the controller will 
supervise and coordinate the system more efficiently. 

This mapped Petri net does not satisfy the property of conservation because of the geo- 
metric characteristics of the system. 

4 Data Structure for Searching Sequences in Petri Net 

The task planning problem is concerned with reachable markings when the system has 
been modeled with a Petri net. The reachability problem is the most basic Petri net anal- 
ysis problem[13]. Many other analysis problems can be stated in terms of the reachability 
problem. 

Definition 9 The Reachability Problem: Given a Petri net C with marking p and a marking 
p' , is p' € R(C,p)? 

Another problem which is similar to reachability but is slightly different is called the 
coverability problem. A marking p" covers a marking p' if p" > p' . 

Definition 10 The Coverability Problem: Given a Petri net C with initial marking p and 
a marking p' , is there a reachable marking p" € R(C,p) such that p" > p' ? 

Briefly speaking, finding a possible sequence is concerned with the reachability problem 
and finding all possible sequences is concerned with the coverability problem. 

Before we describe the algorithm for obtaining the reachability tree for the system 
Petri net, we state some useful definitions, i.e., frontier nodes, terminal nodes and dupli- 
cate nodes[13]. The following algorithm is different from general reachability algorithms in 
the sense of the generation of leaves and the stopping criteria for the developing of the tree 
because our resultant Petri net will have no dead marking as we have shown before. 
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Definition 11 Frontier nodes , terminal nodes and duplicate nodes When we develop the 
reachability tree, all current new markings are called frontier nodes. The markings, in which 
no transition is enabled or depending on some criterion, no further transitions are necessary, 
are called terminal nodes. The markings which have previously appeared in the tree are 
called duplicate nodes. 

In the system Petri net, we define the states of the system as markings. The algorithm 
therefore begins by defining the initial marking, which corresponds to the initial state in the 
system, to be the root of the tree. The final state of the system is defined as the final marking 
in the Petri net. All leaves in the reachability tree are defined to be the final marking. The 
algorithm is based on a breadth-first forward chaining criterion. 

Algorithm 2 The generation of the reachability tree. 

Input: Petri net Np = (P,T,a,0,p 0 ), final marking pj. 

Output: The corresponding reachability tree. 

Let x be a frontier node to be processed. 

1. If there exists another node y in the tree which is not a frontier node, and 

\ has the same marking associated with it, p[x\ = p[y], then classify node x as a 

duplicate node. 

2. If the marking p[x] = pj, then classify node x as a terminal node. 

3. For all transitions tj G T which are enabled in p[x], [i.e., S(p[x],t : ) is de- 
fined], create a new node z in the reachability tree. The marking p[z] associated 
with this new node is, for each place pi, p[z\i = 6(/x[x],fj),-. 

An arc, labeled tj, is directed from node x to node z. Node x is redefined as an 
interior node ; node z becomes a frontier node. 

4. When all nodes have been classified as terminal, duplicate, or interior, dupli- 
cate nodes will copy all descendants from its corresponding nodes. Then duplicate 
nodes will be reclassified as interior nodes. 

5. When all nodes have been classified as terminal or interior, the algorithm 
stops. 

Following the algorithm shown as above, we could generate a reachability tree for the 
sample Petri net shown in Figure 4 and finally we could obtain the assembly sequences 
required. In this case, only one shortest sequence is available. The sequence of transition 
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firings and the corresponding sequence of markings are shown in figure 6. Note that the 
sequence of places in markings are: R, S, T, SR, ST and RST, respectively. 

5 Task Sequence planning for a Practical Problem 

In this section we consider a practical problem using the methods described above. Our 
solutions to this problem will still be based on the task geometric descriptions. The states 
of the system is completely decided by the geometric relationships amongst the objects and 
their internal geometric states. Each efficient operation which will be represented as a cor- 
responding transition in the Petri net acting inside the system will cause the changes of 
feasible geometric states. 

The system consists of a robot, two tables and a book. Figure 7 shows an initial state 
and the desired final state which could be mapped to the geometric descriptions. The only 
difference between these two states is where the book is. Therefore, we consider all feasible 
geometric states for one object, within two objects and among three objects(figure 8). For 
this problem, we assume the maximum size of the robot gripper is not large enough for the 
robot to grasp the book when the book is fully lying on the table. It is thus necessary to 
first move the book to the edge of the table and try to pick up the book from one side of 
the book. This is the reason why we distinguish two cases for the connectedness of the book 
and a table. For the connectedness of three objects, the cases are a little bit more complex 
because of the relative geometric relations between the book and table. When the book is 
on the edge of the table and the robot is touching one side of the book from our view, we 
ignore the place of the robot relative to the table, i.e., ( T X BR ) 4 and ( T 2 BR) 4 may include 
two kinds of geometric relations. 

From the system geometric states diagram, we obtain the AND/OR net representation 
for the moving task(figure 9). For simplicity of the figure, the net is shown as separate sub- 
nets, but because of the common nodes in each subnet, it is really a connected net. We map 
this AND/OR net to the Petri net(figure 10) following Algorithm 1 described before. The 
description for each operation could be deduced from the Petri net and the corresponding 
system geometric states descriptions. By searching the reachability tree of this Petri net and 
following the Algorithm 2, we obtain all possible task sequences and the optimal sequence 
or the fewest-number-step sequence in this case is shown as follows. 
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(a) Transition fireable: ti 
Marking: 111000 
Operation: None 



(b) Transition fireable: t 2 ,t 3 
Marking: 001100 
Operation: Robot grasps solid 



(c) Transition fireable: t 4 , t 5 
Marking: 000001 
Operation: Robot reaches table 



(d) Transition fireable: t 6 
Marking: 100010 
Operation: Robot leaves table 


Figure 6. The sequence of markings and corresponding operations 
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(a) 



(b) 


Figure 7. A Robot Moves a Book from Table 1 to Table 2 
(a) Initial states (b) Final states 
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Final States 

Figure 11. Task Sequences for Moving Book 
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1. < 10 : the robot moves towards table 1 and touches the book which is lying on 
the surface of table 1. 

2. t\ 4 . the robot forces the book on table 1 to move to the edge of the table. 

3. <n : the robot leaves the book and table 1. 

4. <6* the robot reaches table 1 again and grasp the book towards the edge of 

table 1. 

5. <4: the robot which has grasped the book leaves table 1. 

6. <15: the robot moves towards table 2 and make the book touch the surface 
and lie on the edge of table 2. 

7. <17: the robot leaves the book and table 2. 

8. <24- the robot touches the book again but the direction of the gripper has 
already been changed. 

9. <25: the robot forces the book to move to the center of the surface of table 2. 

10. <21: the robot leaves the book and table 2 and then go back to its original 
place. 


This is the only optimal solution which could be found for this problem. This optimal 
task sequence is directly perceived through Figure 11. This sequence is obviously reversible. 

6 Conclusions 

The AND/OR net is introduced as a tool for representation and reasoning about geomet- 
ric constraints in a robotic workcell system. A method for mapping the AND/OR network 
to a Petri net is provided. We could obtain all possible task sequences by constructing the 
reachability tree from the Petri net. This off-line planning system has been implemented. 
The ideas presented here can be applied to other robotic planning problems in manufacturing 
and non-manufacturing domains. 
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